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The purpose of this paper is to discuss an epoch detection procedure 
which is very useful for the resolution and detection of signals overlapping in 
time. An epoch is the beginning instant of a signal. The epoch detection 
procedure is based on the following hypotheses: On the nidi hypothesis Ho 
that a certain instant t is not an epoch, analytical continuation exists at t, 
and one may predict the signal in the future based on past experience 
or vice versa. On the hypothesis Hi that t is an epoch, the analytic continua- 
tion is disrupted at t. 

Based on this idea and the assumption of a Gaussian noise, a test statis- 
tic is derived from the maximum likelihood principle. The test statistic 
may be obtained at the output terminal of a linear filter. The performance of 
such a system is considered. Also discussed briefly are the cases of over- 
lapping stochastic signals and overlapping radar signals. Some experi- 
mental results obtained from a digital computer are shown. 

I. INTRODUCTION 

Consider a signal composed of a train of overlapping wavelets.* The 
wavelets may, for one reason or another, arrive at the receiver (or 
measuring apparatus) delayed by different amounts of time. The time 
delays of the individual wavelets are unknown, but their differences may 
be relatively small so that the wavelets overlap. The beginning instant 
of each wavelet is called an epoch. These signals are corrupted with 
Gaussian noise. Our problem is to detect the overlapping in time. In 
other words, we wish to design a practical system which enables us to 
resolve the received signal train into overlapping wavelets and to de- 
scribe them individually. 

The theory of statistical detection of signals buried in noise has been 
well established. 1 " 4 In the field of resolving overlapping wavelets, Hel- 

* We use the word "wavelets" for the individual overlapping wavelets, and 
reserve the word "signal" for the over-all signal train. 
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strom 5 discussed the optimum detection of two overlapping wavelets. 
With his assumption that one wavelet is separated from the other by 
known amount of time, the problem is considerably simplified and 
relatively easy to handle. Nilsson 6 discussed the problem of resolving N 
overlapping wavelets by deriving an equation to be maximized in an 
Af -dimensional parameter space. Even in the case N = 2, the maxi- 
mization of this equation is very complex and practically unsolved. 
Root 7 considered the general resolvability of radar signals, but gave no 
decision rule. Other studies related to signal resolution place most 
emphasis on the study of ambiguity functions 8,9 and on the design of a 
radar waveform which is inherently suitable for signal resolution. 10 

Generally speaking, for N overlapping wavelets, an optimum detec- 
tion procedure would always involve searching for the maximum value 
of a likelihood function in an iV-dimensional parameter space. 6 For N 
large this is hardly practical, and furthermore, if the number N is un- 
known, the problem becomes even more complicated. In a recent memo- 
randum, 11 the author suggested an epoch detection procedure based 
on the properties of the signal at the epochs. The basic idea was 
to use a portion of the received signal in the past to predict the signal 
in the future, and to announce the arrival of a new wavelet if the pre- 
diction failed sufficiently badly. The present paper originated from that 
work. We intend to formalize and to develop the principle of epoch 
detection. 

Consider a signal f(t) consisting of two overlapping wavelets as shown 
in Fig. 1. The function f(t) is analytic everywhere except at the two 
epochs h and fe • For any instant t which is not an epoch, it is possible 
to use the signal immediately prior to t to predict the signal immediately 
after. This is indeed the property of analytic continuation. However, 
at the two epochs, the statement is no longer true. Indeed we may de- 
fine an epoch as an instant at which analytic continuation is disrupted. 




Fig. 1 — Overlapping signals. 
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It is precisely this disruption of analytic continuation that enables us 
to detect the epochs. In practice, we shall use the signal representation 
technique to describe such disruptions. 

We make the assumption that any wavelets, though close enough to 
cause overlapping, are separated by at least T seconds, i.e., 

\ti-U\±T, (1) 

where tj , t k arc any arbitrary epochs and T is a predetermined quantity. 
This assumption is necessary for our formulation, since for any instant 
t we shall utilize the information in the time interval (t — T, t + T) 
to determine whether / is likely to be an epoch. We further assume 
that any 2T-second segment of the individual wavelets is representable 
by a set of known component functions. Then the disruption of analyti- 
cal continuation simply means that if an epoch exists in a certain 2T 
interval the signal in that interval is no longer representable by the set 
of component functions. Likelihood functions may be formulated in 
accordance with these criteria. The instant t which corresponds to a 
maximum value of a likelihood ratio is then the estimate of the epoch. 
This is of course the well-known maximum likelihood method of signal 
extraction, which has some theoretical advantages. ' Other parame- 
ters of the wavelet may be estimated simultaneously. 

Using the epoch detection scheme, we haVe in fact reduced an JV-di- 
mensional problem to N one-dimensional problems. Undoubtedly, in a 
process such as this, some information is lost, and one cannot expect 
optimum signal resolution except for some extreme cases. However, 
the simplicity and the practicality of the process justify our investiga- 
tion. The process should be especially useful in the case of strong signals 
for which the advantage of a simple system outweighs that of optimality. 
In addition, the concept of epoch detection deserves to be studied and 
developed on its own right. 

II. STATISTICAL EPOCH DETECTION 

Let us denote the deterministic signal by/ s (0, the random Gaussian 
noise by /»(<)> and the noisy signal by /,+»($)• In this section, we shall 
consider the case that the deterministic signal consists of N overlapping 
wavelets with each wavelet being of the same waveform. Then we may 
write 

fs + n(t) =/ s (0 +/.(*) 

2 (2) 

= ZUi/„(*-fe) +/»(*), 
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where At, and t k are the amplitude and the true epoch of the fcth wave- 
let respectively. The function /,,(t) represents the waveform of the 
individual wavelets. 

To begin with, let us assume that each wavelet is representable by a 
set of known component functions. This assumption presents no theo- 
retical difficulty since, by using a set of component functions that 
constitute a complete set, one may represent any continuous signals to 
any degree of accuracy. 14 However, practical considerations limit us 
to use a set of a finite number of component functions. We are particu- 
larly interested in the classes of component functions known as gener- 
alized exponentials, which include real and complex exponentials, sinu- 
soids, polynomials and possible sums of products of such functions. 
The generalized exponentials have the following important property. 
A finite and properly-chosen set of generalized exponentials, as a set, 
goes into itself under the translation of time. 15 As a result, if a wavelet 
f w (r) is exactly representable by a properly chosen set of m generalized 
exponentials y (,) (t), i = 1,2 • ■ ■ m, i.e., 

0, - 00 ^ T < 0, 

(3) 



U(r) = 



Ec,(0)/'(r), 0^ r ^ oo, 



then the tail of f w (r) is also exactly representable by the same set of 
generalized exponentials, 

m 

U(t+T)=T,c<(t)<p (i) (r), 0$/^«, O^rg*. (4) 
i=i 

where c,(i) is the ith coefficient for a time translation of t seconds. 
Obviously, under this condition our earlier assumption that every 2T 
segment of the individual wavelets is representable by the set of com- 
ponent functions is fulfilled. The full significance of this property will 
be appreciated later, when we derive the test statistic for epoch detec- 
tion. 

The assumption of generalized exponentials is not as restrictive as 
it first appears. For one thing, most physical wavelets may be represented 
by a few terms of these functions. Furthermore, almost all commonly 
used functions for signal representation or curve fitting belong to the 
classes of generalized exponentials, and if we are willing to tolerate 
some inaccuracies by an approximate representation, practically all 
waveshapes may be represented by them. It is interesting to note that 
for the generalized exponentials <p l> (r) analytic continuation exists 
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everywhere except at r = 0. Consequently, the epoch of a wavelet 
f w (r) described by (3) satisfies our earlier definition of disruption of 
analytic continuation. 

Next, consider the Gaussian noise f n (t) having a covariance function 
R(t). 16 The covariance function may be taken as the kernel of an 
integral equation, 

f T R(t- T)^ U) (r)dr = X^ 0) (r). (5) 

For our problem, R (t) is real and symmetric, the eigenvalues, Xy , 
are positive, and the eigenf unctions, ^ 0) (t), are orthonormal real 
functions. Both deterministic and random signals may be expressed in 
terms of these eigenf unctions. 1 '* Thus, we may write 

/.+«(* + t) = 5>y(0* o) (r), 

/.(«+r) = E*i(0^ O) (r), 

(6) 
/„(*+r) = E»i(0^ O> (r), 

g t ^ 2T, 
r (0 (r) = EM W (0, 0^t^2T, (7) 

»i(0 - f /.+«(* + r)^ 0) (r)dr, 

•'0 

•i(0 = /"/.(* + T)+ U) (r)dT, (8) 

•M) 

%(0 = f/.C* + r)* (i) (r)dT, 
■'o 



and 



with 



and 



y = I" <p W (T)+ U \T)dT. (9) 



It is essential to note that by this expansion, the random variables 
nj (and also Vj) are independent variables with variances X 7 . Since we 
are not interested in the singular case, we assume that 
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-i V (10) 

;=1 Ay 

We are now in a position to derive the test statistic for epoch detec- 
tion. Let us start with the simplest case. 

2.1 Known Wavelet at Known Epoch 

In this case, we assume that there are reasons to believe that a wave- 
let in the form of A k f w {t — t k ) may arrive. Both A k and t k are assumed 
known. In assuming known t k , it is also implied that no epoch other 
than tk may appear in the time interval (t k — T, t k -\- T). Let us define 
a function 

um fc<,-n r *,*«•, (u) 

(0, elsewhere. 

We wish to test the hypothesis Hi that the wavelet arrives against the 
null hypothesis H that it does not. Thus, we write 

Ih:Ut k - T + r) - E 6# ( ' } (t), g r ^ 2T, (12) 

« 

and 

#i :/.(«* - T + r) - / f ( T ) + E o* (l) (r), ^ r ^ 27\ (13) 

» 

with/„(r) defined as 

f„(r) a 4i/»(t) - iiEr/W, ^ t ^ 2T. (14) 

The constants u will be denned later. Let us explain these two hypothe- 
ses. In the first place, we notice that in using generalized exponentials 
as component functions, it is implied that <p 1 (t) and consequently 
f w (r) extends from r = to t = *>, as clearly indicated in (3). (The 
case of overlapping pulses will be treated later.) Therefore, on the 
null hypothesis H , although the new wavelet does not arrive, there 
will be tails of previously arrived wavelets appearing in the time inter- 
val (tk — T, t k -\- T). Since every 2T-second segment of these previ- 
ously arrived wavelets is representable by the component functions 
<p (l) (t) with ^ t ^ 27 1 , we obtain (12) with the coefficients &,- to be 
estimated. 

On the hypothesis H\ , the wavelet arrives at t = t k . The term A k h (t) 
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in (14) simply reflects this fact, since /^(t) = for r < T, as shown 
in (11). It is also this term that causes the disruption of analytic con- 
tinuation at tk . In addition to the A:th wavelet, there are also tails 
of previously arrived wavelets, and we might have written for the 
hypothesis Hi , /, = A k j h + 2Z QiP W - For reasons that will be pointed 
out later, we simply split q* into two terms, qi = a,- — AkU , and ob- 
tain (13). 

The random variables are independent when expressed in terms of 
eigenf unctions, and consequently we expand, similar to (6),//,(t) and 
f a (r) into 

fh(r) = EM^Cr), 0£r£2T, 



f (r)= Zg^ir), 0£r£2T, 



(15) 



with 



hi = (' A(r)^ 0) (r)rfr, 
J o 

Qj = A k hj — Ak/2 riUij. 



(16) 



The joint probability density for the null hypothesis may then be 
written as 



Po(v;bi) = 



1 



II (2*Xy) 



exp 



-E 



(i'j - X! billy)* 



2X, 



(17) 



according to (6), (7), and (12). Similarly, we write for hypothesis Hi 
the joint probability density 

-z — 



Pi(v; ai ) = 



II (2irX / ) i 



exp 



2\j 



(18) 



In the absence of a priori information on the tails of previously arrived 
wavelets, a reasonable test is the maximum likelihood test which is 
given by 

max Pi(v;a) 



L = 



max P (v;b) 



^ exp (?;) 



(19) 



with the threshold 77 to be determined either by the Bayes criterion or 
by the Neyman-Pearson criterion. Equation (19) is equivalent to 
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log L = max 



-£ 



— max 
& 



-E 



2\j 

(vj — E biUij) 2 



2\j 



(20) 



^ v- 



In order to simplify (20) somewhat, let us write 



* _ "y 



Mm* = 



*> (i) *(r) = E««V W) (r). 
i 

We assume that it is possible to write 



(21) 



E 



Uljllij 



T Xi 



= hi 



(22) 



a; 



where 6/, is the Kronecker delta. Remembering the orthonormality of 
eigenfunctions, (22) may be written as 

A . j •/() 

= E£ r «^ (W (r)^y y) (r)dr (JB) 



Thus (22) is simply a consequence of the fact that p (r) and ^ (,) * (t) 
form a biorthonormal system. Furthermore, 



= Euij* f T fl( M - T)f 0) (r)rfr 
- f T ^(M - iV fl *(f)dr. 



(24) 



Consequently, <p ' (r) is indeed the solution of an integral equation 
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and may be obtained for given <p (x) (ji) and R(ji — t). 19 Thus it is al- 
ways possible to achieve the biorthonormalization of a set of known 
component functions by means of a process similar to the Gram -Schmidt 
process of orthonormalization. It is appropriate to point out here that 
the assumption of a biorthonormal system is solely for the purpose of 
mathematical simplicity. 

Now let us define the constant r, as 



-,-E^A,. 



Then, according to (16), we obtain 



UifTiUij 



j Ay j,l Aj 

= AkU — A k 2Z riBu 



(25) 



(26) 



= 0. 

In other words, f g (r) is orthogonal to p (t) *(r). Returning to (20), 
we notice that because of (26), log L may be simplified into the form of 

2 r ( v i — JL a.-w-i) 2-1 

Iogi=E"f'-E|- + max -E- 

-z- 



2\j 



— max 

b 



2Xy 



(27) 



However, the last two terms are indeed identical. Thus, 

iog/. = £f -Eg-. 



(28) 



The last term in (28 ) is only a constant, and we may use the statistic 



e=E^'6i 



(29) 



for testing the arrival of the wavelet at the instant / = t k . Here £ is 
the threshold for testing G. 

The results may also be expressed in the form of integral equations. 
Using a procedure similar to that used in (23) and (24), the statistic 
shown in (29 ) may be expressed as 

G = f T f. +n (h - T + r)f„*(r) dr ^ £ (30) 
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with. f (r) being the solution of the integral equation 

fM = I ' R(» - t)/.*(t) dr. (31) 

The function /„ (p ) has been defined in (14) and is rewritten here. 

/.GO = AJkb) - A k S r* w (m). (14) 

» 

The constants ?\- , written in integral form, become 

U = f T h(r)<p (i) *(r) dr (32) 

according to (25). For a white noise with a covariance function 8(t), 
the results are considerably simpler since in this case, 

<P K?) = <p {t), 

f B *(r)=f (r). 

The test statistic G shown in (30) may be obtained by a linear filter. 
If we use a linear filter whose weighting function is characterized by 
f a (t) — or, in other words, if the impulse response of the filter is 
/„*(— t) — then with f s+n (t) as input, the output of the filter gives us 
the desired statistic G with a time delay of T seconds. 14 As examples, 
we show in Fig. 2 some wavelets and the weighting functions of their 
corresponding "matched" filters for epoch detection in white noise. 
(See Appendix.) 

The weighting functions shown in the figure are calculated accord- 
ing to (14). It is essential to note the difference between our "matched" 
filter and the standard matched filter for the detection of non-overlap- 
ping signals. Without interfering signals, the matched filter would be 
/u.(t), while in our case, a term in the form of ^rw (t) is to be 
subtracted from the original waveform, as clearly shown in (14). It 
is indeed the subtraction of this term that enables us to suppress the 
effect of previously arrived wavelets. It is also this subtraction that 
represents the price we pay. 

We wish to compute the false alarm and detection probabilities for 
the epoch detection system which is based on the statistic G. Since G 
is obtained from a linear operation on a Gaussian-distributed variable, 
G is also Gaussian-distributed. 17 Under the hypothesis H , its mean 
value is 

E[G | H„] = f T f *(r) £ 6*> (<) (r) dr = (34) 
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2T T. 




X^ 



2T T- 





(35) 



SIGNALS WEIGHTING FUNCTIONS 

Fig. 2 — "Matched" filters for epoch detection in white noise. 

since f g *(r) and <p (l) (r) are orthogonal. Under the hypothesis Hi, 
the mean value becomes 

E[G\HA = f T f *(r)[f (r) + £« * (fl (t)] dr 

= f 7 fo*(r)f„(r) dr. 
The variance of G under cither hypothesis is 

VarG= f [ f *(T)f a *(n)f n (T)f n (n)dndT 

= [ f f B *(r)f g *(n)R(r - n)d>xdT 

= f T f a *(r)f (r)dr, 
where we have used (31). Thus, 



(36) 



412 THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1965 

d 2 = ( L*(r)fa(r)dr, (37) 

a dimensionless constant, plays the role of signal-to-noise ratio (SNR). ' 
The probability density functions of G are 

po(G) = (2«rf , )-*exp (~G 2 /2d 2 ), (38) 

Pi(G) = (27rrf 2 )" 5 exp [- (G - d 2 ) 2 /2rf 2 ]. 

and the false alarm and detection probabilities are, respectively 3 

Q„ = erfc Wd), 



Q d = erfc (i~ d), 
where erfc (x) is the error-function integral. 

2.2 Unknown Amplitude and Unknown Epoch 

In this case, the two hypotheses become 
Ho:fs(t- T+t) = E&* w (r), 

i 

ffi :/.<«- r+ r) = A(0/.(r) 



(39) 



| t g 2I 7 , (40) 
^ t ^ 22", (41) 



where 



/.(r) - /*(r) - E ^ (,) (r), ^ r g 27\ (42) 



Notice the slight difference between the definition of /„(t) shown in 
(42) and that of (14). The joint probability densities are, similar to 
the previous case, 



ft(! * ) = rn^ exp 

i 
1 

Pi(v;a it A) = 



-E 



(v.- — E OiUij)' 



2\j 



II ( W 



exp 



-E 



(»i — E «M*« - AgjY 

i 

2\j 



(43) 



Using the principle of maximum likelihood estimation, we first make 
for each instant t an estimate of the amplitude, A{t), and then make 
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an estimate of the epoch, t, which corresponds to the maximum value 
of the likelihood ratio of the hypothesis Hi against the hypothesis i/ P . 
Thus 



L(A,t) = max L(A,t) = max 



max Pi(v;a,i , A) 

a, A 

max P (v;bi) 



(44) 



By the same argument leading to (28), we obtain 

\ogL(A,t) = max log L( A,t) = max [max log L( A ,t)] 



= r E 2Ma^-AWl 

t.A L i 2Xj J 



(45) 



Taking the partial derivative with respect to A , 

d log L(A,t) 



dA 



= 0, 



(46) 



we get A (t), the maximum likelihood estimate of A (t), 



A(t) = 



SSl/frfl- (47) 



It should bo noted that the random variable Vj is also a function of /, 
as shown in (8). Substituting (47) into (45) gives us 



log L(A,t) = max^i^^]- 
If we normalize function /„(t) such that 
T,f= fV(r)/ (r)dT 

= \l R(T - n)j {n)f a (T)dndT 

•'u •'u 



(48) 



(49) 



= 1. 



then 



and 



A(t) = E^ = f r /. + nU - T + T)f g *(r)dr, 



X; 



(50) 



\ogL(A,t) = max log L(4, £) = max -| ,1(0 
t t & 



(51) 
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Thus the instant I that corresponds to the maximum value of log L(A,t) 
will be our estimate of the epoch. Indeed we may base our estimate on 
the maximum value of \ A(t) |. Equation (50) may of course be gen- 
erated by means of a linear filter. If /a(t) and consequently J w {t) 
are properly "normalized" in the sense of (49) and (42), the signal- 
to-noise ratio (SNR) for the A;th Avavelet is Au. Following the 
procedure used by Woodward and Davis, 20 it can be shown that, for 
the strong-signal case, the variance of the epoch estimate i is in- 
versely proportional to SNR and to the square of the filter bandwidth. 
We notice that the performance of an epoch detection system is 
related to the component functions only indirectly. It is the signal 
waveform itself that is important. As a rule of thumb, the smaller 
the absolute values of the constants r,- are, the more effective the system 
will be. In fact, we may define a useful figure of merit, 



P = 



SNR for epoch detection 



SNR for the detection of //.(r) 

I" f *(r)f (r)dr (52) 

^o 

f fk*(r)fn(r)dT 

as the efficiency of the epoch detection system, where//, (t) is defined 
in the same way as we did for/ *(r). Using (42) and (49) and the fact 
that/„*(r) is orthogonal to <p 0) (t), we have 



p = 



i + E 



(5.3) 



As a result, p < 1. In the limit as every r, approaches zero, p —> 1 and 
the epoch detection system approaches the optimum detection system 
for non-overlapping pulses of duration T seconds. 

2.3 Overlapping Pulses 

A pulse of duration T seconds may be regarded as two overlapping 
wavelets with epochs separated by T seconds. For instance, an expo- 
nential pulse, exp (— t) for ^ r ^ T , may be regarded as the sum 
of two exponential functions, exp (— r) with ^ t ^ =o and 
—exp ( — t) with To ^ t ^ «>. We assume that several pulses may 
overlap. Thus, arrival of a pulse is characterized by the simultaneous 
existence of a wavelet / u . 6 (t) at the beginning epoch fc and a wavelet 
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fw'ir) at the ending epoch t k e where t k = t k + T . For mathemat- 
ical simplicity, we assume that the Gaussian noise in the time interval 
it* - T,tk + T) and the noise in the interval (t k - T, t k + T) 
are uncorrelated. In other words, we assume 

R{t) = for r ^ T - 2T, (54) 

thus enabling us to treat independently the random variables in the 
two time intervals. 

Again we formulate two hypotheses. 

Ho:Mt- T + T ) = EfcV°(r), 

(55) 

SAt + T - T + T ) = E bU (i) (r), ^ r ^ 27', 

t 

and 

Hi :/.« - T + r) = 4(0//(r) + E aW), 

/.(< + T. - 2 1 + t) - A(t)f g c (r) + E a,V W (r), (56) 

i 

^ t ^ 2T, 
where 

!a e (r) b/»'(t) - E r,V W (r), (57) 

i 

£ t £ 2T, 

with //» 6 (r) and ./V(r) defined in the same way as /a(t), and the con- 
stants r t b and r<" defined in the same way as r,- . Let us define 

fo(r) -//(r) + //(t- ft). (58) 

Notice that/ c (r — To) = for t < T . The function /„(t) is norma- 
lized in the sense that 



with 



and 



/■ TQ+-1 T 

/ /••(r)/ f (r)dr = 1, (59) 

•'o 

/.*(r) = ^*(r)+/;*(r- To) (60) 



416 THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1965 



//( M ) = I"' R(H ~ r)f a b *(r)dr, 

(61) 
//(m) - f T R(v ~ r)f g e *(r)dr. 



Equations (58) through (61) can be justified only on the assumption 
of (54). 

Using the maximum likelihood principle, we write 



L(A,t) = max 



max Pi(v; a,- 6 , a,', A) 

a, A 

max Po(v; &»• , &,•") 



(62) 



- & 
With a derivation parallel to that of 2.2, we obtain the final results 

/• To+2 T 

A{t) = E ^ = / /h*« ~ T + r)/ g *(T)dr, (63) 

and 

log L (A,i) = max 1 1 A (t) | 2 . (64) 

i 

Thus, based on the value of \ A(t) |, we may obtain the estimate of the 
epoch i. Again a simple linear filter with a weighting function /„*(r) 
defined in (60) will suffice to generate A (t). 

III. OVERLAPPING STOCHASTIC SIGNALS 

Again we consider a train of overlapping wavelets corrupted with a 
Gaussian noise. Each wavelet is assumed to be representable by a set 
of m known generalized exponential functions. However, the wavelets 
are stochastic in the sense that their exact waveforms are unknown and 
that each wavelet may differ from the other. As a result, the two hy- 
potheses become 

H :f 8 (t- T+t) = E5/(r), 0^t^2T, (65) 

» 

Hi :/.(<- ? + r) = £ a(t)x {i) '(t) 

(66) 
+ Efl/W, ^ r ^ 27\ 



where 



X ( ° (r) = £ /to*" (r " T) - 2 W" (r) (67) 
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with 

/»( T - T) = for t <T. (68) 

The constants fa and yu are constrained by the biorthonormality re- 
lationships. Let ^ 0) (r) be the cigenf unctions of the covariance function 
R (t). For the sake of the independence of random variables, we expand 
the component functions, the noise, etc., in terms of ^ (,) (t). For x (0 (t), 
we then write 

X^ir) = Z^ j '(r), 0=S r ^ 2T. (69) 

i 

The constraints of biorthonormality are 

Z^ = 8u, (70) 

i A ; 

j^wy = o, (71) 



and 

A direct result of (70) and (71 ) is, similar to (2f>) and (32), 



= Su . (72) 



■i= Zt*P* fV } (r - T)+ U) (t)c1t 

i.k A; •'0 

= £*• f\ U) (r- T) V il) *(r)dr. 

I- •'0 



(73) 



To illustrate the procedure for formulating x (<) (t), let us consider 
the simple case of white noise for which the biorthonormality reduces 
to orthonormality. The first step is of course to orthonormalize with 
respect to the time interval (0,2T) the m component functions by means 
of the Gram-Schmidt procedure. Next we may choose any value of fa 
for (67) as long as the m functions £ /3,-«p (,) (t — T), i — 1, 2 • • • m 
are linearly independent. Using (73) for the calculation of yu guaran- 
tees that x (,) (t) is orthogonal to <p U) (t). Finally, by means of the 
Gram-Schmidt process, we may combine the functions x w (t) linearly 
to make them orthonormal. In this way, all three conditions, (70), 
(71) and (72), are satisfied. For colored noise, the procedure is similar. 

Under these assumptions of biorthonormality, an application of 
maximum likelihood principle then gives us 
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C,(t) = £^ = f T f a+ Jl - T + r) X U) *(r) ( lr, (74) 

where x (,) *( r ) is the solution of the equation 



and 



X W (/i) - r R(v - r) X (i) *(r)dr, 

log L(6i , t) = max log (c,- , t) = max - ?, \ Ci(t) | 2 . 
t t \_2 i J 



75) 



(70) 



The estimated epoch I is the instant that corresponds to the maximum 
value of log L(c,-,0- The epoch detection system which generates 
log L (di , t ) will then consist of a summing amplifier, to squarers and 
m linear filters characterized by the to weighting functions x ( * ) *(t)- 

For stochastic signals, a proper definition of SNR for the /cth wavelet 
is 

r/; 2 = -X>,U) f T X U) *(r)x U) (r)dr 
m Si J» 

TO i=i 

where we have used (72). The coefficient, c.-(4), is defined by (66) with 
4 , the /cth epoch, substituted for t. 

Let us now show some experimental results obtained from a digital 
computer. Fig. 3 illustrates the detection of overlapping wavelets, each 
consisting of two exponentials, e~ T and e~ T . Although in our experiment 
the three overlapping wavelets have the same waveshape, they are 
regarded as stochastic since we do not assume the a priori knowledge of 
the proportion of the two exponentials that constitute the wavelets. 
The signals are additively corrupted with white noise as shown in the 
second row. With the definition of (77), the signal-to-noise ratios for 
our examples are, in decibels, oo , 15 and 8, respectively. Since we know 
the component functions, e~ T and e~~ T , what we need to do would be 
simply to estimate the coefficients c,(0 by means of linear filters pre- 
scribed by (67) and then calculate log L(c,-, t) according to (76). 
What we actually did is based on a more primitive model; nevertheless, 
the basic philosophy is the same. Using this primitive model, the loga- 
rithms of the likelihood ratios, log L/(t), are calculated over the noisy 
signals, and shown in the third row. It is clear from the figure that the 
estimated epochs t which correspond to the maximum value of log 
L/(t), almost coincide with the true epochs. However, for the 8-db 
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Fig. 3 — Detection of overlapping wavelets. 

case, the detection probability is low, and the peak corresponding to the 
second epoch is almost not distinguishable from the peaks which are 
due to the random noise alone. With the epochs estimated, one may 
estimate in a piecewise manner the signal between the epochs, and the 
signals /,/ (0 thus detected are shown in the last row. 



IV. OVERLAPPING RADAR SIGNALS 

The most important application of statistical detection theory is in 
radar signal detection. We shall consider typical radar pulses which are 
sinusoidal signals modulated by square waves. Each pulse, as discussed 
in Section II, can be characterized by a beginning epoch and an ending 
epoch. For simplicity, we treat them separately as two epochs. 

For overlapping radar signals, we may write 

N 

MO cos (u e t + 6) = Y,A k U{t - t k ) cos (u e t 4- 6 k ), (78) 
t— i 

where we have regarded f„(t) and/ ir (r) as envelopes of the sinusoidal 
signals and 6 k are phase angles. The pulse envelope f w (r) is a square 
wave. Similarly we consider /,+„ (t) as the envelope of the noisy signal. 
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The epoch detection system developed previously is difficult to imple- 
ment in this case because it is sensitive to radio-frequency phase. For 
this reason, we assume the use of a perfect envelope detector to take the 
signal envelope first. 17 The noise under this condition becomes narrow- 
band noise. Let us designate, for a certain instant t, the envelope of the 
sinusoidal signal by a and the envelope of the noisy signal by v. With 
a variance X, the probability density for the envelope at time t on the 
hypothesis that the sampled waveform is sine-wave plus noise is, ac- 
cording to the classic work of Rice, 21 

[o otherwise, 

where h(x) is the modified Bessel function of the first kind and order 
zero. It is known as the modified Rayleigh distribution or the Rice 
distribution. On the hypothesis that the sampled waveform is noise 
alone, a = and 7 (0) = 1, and (79) is reduced to the Rayleigh dis- 
tribution. 



pa(v) = 



I cxp (- fx) v = °* 



(80) 



0, otherwise, 

We again formulate a null hypothesis H» and a hypothesis Hi that 
an epoch has arrived. Thus, 

H :f.(t - T + r) = an, g t g 2T. (81) 

H l :f 8 (t-T+T) = h> Hit*, < 82 > 



a-2 



T ^ t ^ 2T. 



We may look for a coordinate system such that the random variables 
on these coordinates are statistically independent. However, unlike the 
Gaussian distribution, it is very difficult to find such a coordinate sys- 
tem. The usual procedure, which we shall follow here, is to use for 
coordinates samples of the envelope waveform taken at regular inter- 
vals and far enough apart so that it is a reasonable approximation to 
suppose them statistically independent. We take in the time interval 
(t — T, t + T) 2M measurements at 2M uniformly spaced instants 
separated by At seconds apart. Let us write for the instant t 

vj(t) =/.+»(*- r + ;Ar). (83) 

Then on the null hypothesis H , the joint probability density is 
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2M / 2 , 2\ / \ 

D (.. \ TT V ) ( V) ~r OLa \ T ((X(>Vj\ 

?.<«;*.) = Q ,- exp {- -^-j /. ^ j , 

while on the hypothesis H i , we have 

+ A?"(-^>(?) 

The maximum likelihood principle then requires 

max P\{v;a\ , a*) 
L(a, i) = max 
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(84) 



(85) 



max Po(v;ao) 



(86) 



By considering the logarithm of the likelihood functions and taking 
partial derivatives, we can easily show that 



and 



M 

E 



2.1/ 

E 



2 M 

E 



XX 



02 , v. 
X ' X 



»(¥)J 



(x) . 

, / /oo«A 1 

(x)_ 



= o. 



= o. 



(87) 



_ an . 
\ + X 



= o, 



(88) 



where ai, a2 , «o are the maximum likelihood estimates of ai , a 2 , a 
respectively, and h is the derivative of I . The estimated epoch then 
corresponds to 

,o g ,U ( -) = m a x {E[-| + log/.(^)] 
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It should be noted that a and v, are functions of t. Our problem would 
have been solved if we had been able to solve (87) and (88) for a, 
substitute them into (89) and then search for i that corresponds to 
the maximum value of log L(a,t). An explicit solution in this case is, 
to say the least, very difficult. Certain approximations are needed. 
We shall discuss the case of strong signals and the case of weak signals 
separately. 

In the first place, we notice that if the signal-to-noise ratio is suffi- 
ciently high — i.e., a, 2 /2X » 1 and a 2 2 /2X » 1 [(a, 2 - a 2 2 )/2X may be 
small] — the Rice distribution approaches the Gaussian distribution 
and the discussion in Section II is directly applicable. A linear filter 
may thus be used. On the other hand, if ai 2 /2X » 1 and a 2 2 /2X small 
or vice versa, we encounter the epoch of a large pulse. Therefore a sub- 
optimal epoch detection scheme may be used, and again a linear filter 
may be chosen for its simplicity. 

Finally, consider the case that ai/2X « 1 and a 2 2 /2X <3C 1. It is well- 
known that for small x (see Ref. 22), 



Ia(x) = 



\ogh(x) = 



1 +1^ 



1 



l 2 -2 2 



+ 



(90) 



+ 



If we substitute (90) into (87)^ and (88) and retain only those terms 
that involve a/\/\ and (a/\/\) 3 , we obtain as approximations 



and 



2X 

„ 2 

2X 



an 
2X 



it r 2 ~j / M 4 

§ L.2X~ *_ / S 8X 2 "' 

2M r«. 2 

) = M+1 \_6\ 



lit 

£ 



8X 2 ' 



2M [v 



2 

2X 



1 



H 8X 2 ' 



(91) 



(92) 



Similarly, substituting (90) into (89) gives us 

2 A/ r 2 

V I 

2X 

2 



log L(a,i) = max jg g I | 

a 2 2M r, 
2X fm.U+1 [_2X 



, a 2 4 

_ i _ I^L x li_ 
2 2X 8X 2 



_ i _ t _ J— 



a 2 1M r„ 2 

_ f*L V \±- 
2X U. L2X 



i " 2 41 
1 02_ y>_ 

2 2X 8X 2 J 

i -> 2 4 -f\ 

1 an fly I 

2 2X 8X 2 J| " 



(93) 



1 _^ »*«_ "_l 
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An epoch detection system based on (91), (92), and (93) is very 
difficult to implement. It needs further simplification. We notice that, 
for M sufficiently large, the random variables take on nearly all possible 
values of the probability functions. The summations then represent 
an ensemble average. For example, with «i /2X «. \ 3 






i+ y 



(94; 



where p(x,ai) is the Rice distribution shown in (79). We may of course 
do the same for ai /2X and ao /2\. It is indeed from this consideration 
that we include the term 

-. a2 4 

1 a Vj 

2 2X8X~ 2 

in (93), since it is of the same order as the difference of the remaining 
two terms. 

From the consideration of order of magnitude, it should be obvious 
that for (91) and (92) the denominators may be replaced by M and 
2M respectively. As a result, we may write 



a 2 1 /" 2 a 2\ 



a 2 1 /" 2 

an 1 la\ 

2X " 2 V2X 



Using (91), (92), (94), and (95) for (93) and simplifying, we finally 
obtain 

(96) 



.1/ 



A 2 A 2 

= m f X T|2X-2X 



1 
= max -r-rj 
t AM 



2.W 2/,\ M 2/,\ 

-y Vj U) _ -y Vj (I) 

jwr+i 2X j=i 2X 



A test may naturally be based on the quantity inside the absolute sign. 
A large positive value for the quantity indicates the arrival of a be- 
ginning epoch, and a large negative value corresponds to an ending 
epoch. A pulse is of course marked by the arrival of both epochs. The 
result is consistent with the conventional square-law detector for small, 
nonoverlapping signals. 
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V. CONCLUSION 

We have investigated the problem of epoch detection. A test statistic, 
which may be obtained from a simple, linear filter, has been derived for 
Gaussian noise. In the derivation, we have assumed that each wavelet 
is representable by a set of known generalized exponentials. This is not 
as restrictive as it appears, considering the fact that any continuous 
signal may be represented with a least-square error as small as we wish 
by using a sufficient number of component functions. 

The epoch detection scheme is particularly useful for the resolution 
and detection of overlapping signals. For N overlapping wavelets, the 
procedure reduces the resolution problem from an iV-dimensional 
problem to N one-dimensional problems. Some information is lost in 
this reduction, and consequently it is not a scheme for optimal resolu- 
tion. However, it has the essential advantage of simplicity and prac- 
ticality. 

The performance of the epoch detection system has been considered 
briefly. The discussions of overlapping stochastic signals and over- 
lapping radar signals show that the method is applicable to these cases, 
and the experimental results enhance our confidence in the detection 
procedure. 
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APPENDIX 

The weighting functions of the "matched" filters are calculated 
according to the equation 

fair) =fn(r) - £ r#»<'> (r), 
» 

where r.'s are chosen in such a way that for white noise /„(r) is orthog- 
onal to every p (,) (r). This orthogonality (or biorthogonality for 
Gaussian noise) is the central idea of epoch detection, and has been 
discussed in the paper. 
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As an example, for the last signal in Fig. 2, the signal (or wavelet) 
is of the form 

fw(r) = e~ T - e~ 2T , 

and therefore from (11) 

r (T " r) - <r 2(T - 7 '\ t ^ T ^ 2T, 

10, elsewhere. 



A(r) = 
Thus we have 



f , \ _ f-r* T ~ r* 2r , ^ r < T, 

M^ " 1 (e r - *)«- - (e 2r + r 2 )e" 2r , T g r rg 27\ 

with 1\ and /- 2 to be determined by the orthogonality relationships 

/ SMe^dr =0, 

•'o 

f f u (T)e- 2T dr = 0, 

In our example, T = 0.7, and then the solution of the above two equa- 
tions is 

n = 0.02 and r z = -0.76. 

A substitution of these values into the equation of f g (r) results in 

'-0.62e~ r + 0.76e~ 2r , ^ t < 0.7, 



f°( T ' [ 1.39e~ T - 3.30e~ 2r , 0.7 ^ r ^ 1.4, 
which, except for a scale factor, is the weighting function shown in Fig. 2. 
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